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DETAILED ACTION 

Continued Examination Under 37 CFR 1.114 

1 . A request for continued examination under 37 CFR 1.114, including the fee set 
forth in 37 CFR 1.17(e), was filed in this application after final rejection. Since this 
application is eligible for continued examination under 37 CFR 1.114, and the fee set 
forth in 37 CFR 1 .17(e) has been timely paid, the finality of the previous Office action 
has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on 
9/22/2009 has been entered. 

Response to Arguments 

2. Applicant's arguments with respect to claims 15-26 have been considered but 
are moot in view of the new ground(s) of rejection. 

With respect to the Applicant's argument regarding claim 1 , the Applicant 
argues that Cui does not teach "structured display capability information that 
includes backlight luminance information as a sub-element of the display 
capability information." 

However, Examiner respectfully disagrees. Examiner respectfully asserts 
that the backlight luminance information must be provided in step 606 of Fig. 6. 
A software program controls the display image brightness and display backlight 
brightness. The control cannot be accomplished without such backlight 
information included as a sub-element. Please refer to the rejection below. 



Application/Control Number: 10/511,238 
Art Unit: 2629 



Page 3 



Therefore, the argument is moot. 

Claim Rejections - 35 USC § 103 

1 . The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

2. The factual inquiries set forth in Graham v. John Deere Co., 383 U.S. 1 , 148 
USPQ 459 (1966), that are applied for establishing a background for determining 
obviousness under 35 U.S.C. 103(a) are summarized as follows: 

1 . Determining the scope and contents of the prior art. 

2. Ascertaining the differences between the prior art and the claims at issue. 

3. Resolving the level of ordinary skill in the pertinent art. 

4. Considering objective evidence present in the application indicating 
obviousness or nonobviousness. 

3. Claims 15-22 are rejected under 35 U.S.C. 103(a) as being anticipated by 
Cui (US 2003/0001815 A1) in view of Croney et al. (Hereinafter "Croney" US 
2004/0073873 A1). 

Re claim 15, Cui teaches a visual data adaptation method comprising: adapting 
visual data in response to received first display capability information of a display device 
in a first user terminal and a usage environment of the particular user terminal (Para 
0037; "If a color segment brightness level exceeds or falls below the respective 
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segment threshold/display capability by a certain amount, this information is relayed to a 
software program, which determines whether the display image brightness or backlight 
brightness should be adjusted." The display capability information is the information 
used to maintain a pre-determined display image quality. The particular user terminal is 
where the display device as shown in Fig. 1 . Para 0038; "an ambient light sensor is 
used to determined the brightness of ambient light surrounding a display monitor, in 
which the display image will be display. The image may then be adjusted to account for 
ambient light brightness."); 

and outputting the first adapted visual data to the particular user terminal, 
wherein the display capability information is hierarchically structured to include backlight 
luminance information as a sub-element of the display capability information (Para 
0037; "when a color brightness level exceeds or falls below a threshold by an amount, 
an interrupt is generated causing a software program to either program the graphics 
gamma unit to adjust the display image brightness or enable the PWM to adjust the 
display backlight brightness in order to maintain a pre-determined display image 
quality." In order to maintain the pre-determined display image quality, which is the 
display capability, the software program must contain both the display image brightness 
and the backlight brightness information as sub-elements to dynamically adjust the 
image brightness.), and the backlight luminance information is described as a numerical 
value ranging from a lowest possible value to a highest possible value that is adjusted 
according to the usage environment of the particular user terminal (Para 0037; "if a 
target display image quality can be achieved by adjusting the backlight brightness while 
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maintaining a target display device power target, then the PWM will be programmed 
accordingly. Otherwise, the target display image quality will be achieved by adjusting 
the display image brightness." The adjustment of the backlight brightness is conducted 
by a program wherein the backlight brightness is described digitally in numerical values. 
The range of the backlight brightness information is determined by the target display 
image quality described above. In other words, if the highest possible value of the 
backlight is not sufficient, the software program will relay the information to adjust the 
image data.). 

But does not expressly teach adapting the visual data in response to received 
second display capability information of a second display device in a second user 
terminal and providing a single source, multi-use environment, where one content is 
adapted to and used in different usage environments. 

However, Croney teaches a method for rendering images for display on client 
devices wherein an image or images having the appropriate size and format compatible 
with each client device based on the capabilities and environment associated with the 
particular client device is generated from a single source image (Croney: Para 0009). 

Therefore, taking the combined teachings of Cui and Croney, as a whole, it 
would have been obvious to a person having ordinary skill in the art to incorporate the 
idea of renderings images on a plurality of client devices wherein images having the 
appropriate size and format compatible with each client device based on the capabilities 
associated with the particular client device is generated from a single source image as 
taught by Croney into the visual data adaptation method of Cui to obtain the method of 
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adapting visual data in response to received display capability information of a plurality 
of display devices including a first and a second display in separate user terminals to 
adept a single-source content be used in different usage environments to allow a single 
source content to be properly displayed on a multiple client devices automatically. 

Re claim 16, Cui teaches wherein the visual data is RGB data of pixels (Para 
0035; "The graphics gamma unit effects the brightness of an image to be displayed on a 
display monitor by scaling each sub-pixel color." The sub-pixel color data are RGB 
data.). 

Re claim 17, Cui teaches wherein the adaptation is to control pixel value of the 
visual data according to the backlight luminance information by shifting an RGB value 
(Para 0035; "The graphics gamma unit effects the brightness of an image to be 
displayed on a display monitor by scaling each sub-pixel color." Scaling the sub-pixel 
color value is equivalent to shifting and RGB value.). 

Re claim 18, the combined teachings of Cui and Croney teaches the visual data 
adaptation method as recited in claim 15, wherein the backlight luminance information is 
adjusted according to the adjusted visual data transmitted from the separate user 
terminal (Para 0037; "other decision algorithms may be used to determine whether a 
display image brightness should be changed or backlight brightness should be modified 
in order to achieve or maintain an image quality while achieving or maintaining a power- 
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consumption target." The adjustment of the backlight brightness is conducted by a 
program according to the adjusted visual data. After adjusting the visual data, further 
adjustment is necessary to maintain the image quality, the backlight brightness will be 
adjusted. The software will dynamically adjust both the visual data and the backlight 
brightness as the threshold of the image quality necessitates them.). 

Re claim 19, Cui teaches a visual data adaptation apparatus comprising: 
an adaptation means for adapting visual data in response to received display capability 
information of a first display device in a first user terminal and a usage environment of 
the particular user terminal (Para 0037; "If a color segment brightness level exceeds or 
falls below the respective segment threshold/display capability by a certain amount, this 
information is relayed to a software program, which determines whether the display 
image brightness or backlight brightness should be adjusted." The display capability 
information is the information used to maintain a pre-determined display image quality. 
The user terminal is where the display device as shown in Fig. 1 . The adaptation 
means is the system as shown in Fig. 1 . Para 0038; "an ambient light sensor is used to 
determined the brightness of ambient light surrounding a display monitor, in which the 
display image will be display. The image may then be adjusted to account for ambient 
light brightness."); and an outputting means for outputting the first adapted visual data to 
the particular user terminal, wherein the display capability information is hierarchically 
structured to include backlight luminance information as a sub-element of the display 
capability information (Para 0037; "when a color brightness level exceeds or falls below 
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a threshold by an amount, an interrupt is generated causing a software program to 
either program the graphics gamma unit to adjust the display image brightness or 
enable the PWM to adjust the display backlight brightness in order to maintain a pre- 
determined display image quality." In order to maintain the pre-determined display 
image quality, which is the display capability, the software program must contain both 
the display image brightness and the backlight brightness information as sub-elements 
to dynamically adjust the image brightness.), and the backlight luminance information is 
described as a numerical value ranging from the lowest possible value to the highest 
possible value that is adjusted according to the usage environment of the particular user 
terminal (Para 0037; "if a target display image quality can be achieved by adjusting the 
backlight brightness while maintaining a target display device power target, then the 
PWM will be programmed accordingly. Otherwise, the target display image quality will 
be achieved by adjusting the display image brightness." The adjustment of the backlight 
brightness is conducted by a program wherein the backlight brightness is described 
digitally in numerical values. The range of the backlight brightness information is 
determined by the target display image quality described above. In other words, if the 
highest possible value of the backlight is not sufficient, the software program will relay 
the information to adjust the image data.). 

But does not expressly teach adapting the visual data in response to received 
second display capability information of a second display device in a second user 
terminal and providing a single source, multi-use environment, where one content is 
adapted to and used in different usage environments. 
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However, Croney teaches a method for rendering images for display on client 
devices wherein an image or images having the appropriate size and format compatible 
with each client device based on the capabilities and environment associated with the 
particular client device is generated from a single source image (Croney: Para 0009). 

Therefore, taking the combined teachings of Cui and Croney, as a whole, it 
would have been obvious to a person having ordinary skill in the art to incorporate the 
idea of renderings images on a plurality of client devices wherein images having the 
appropriate size and format compatible with each client device based on the capabilities 
associated with the particular client device is generated from a single source image as 
taught by Croney into the visual data adaptation apparatus of Cui to obtain a visual data 
adaptation apparatus to adapt visual data in response to received display capability 
information of a plurality of display devices including a first and a second display in 
separate user terminals to adept a single-source content be used in different usage 
environments to allow a single source content to be properly displayed on a multiple 
client devices automatically. 

The limitations of claim 20 are substantially similar to the limitations of claim 16. 
Therefore, it has been analyzed and rejected substantially similar to claim 16. 

The limitations of claim 21 are substantially similar to the limitations of claim 1 7. 
Therefore, it has been analyzed and rejected substantially similar to claim 17. 
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The limitations of claim 22 are substantially similar to the limitations of claim 18. 
Therefore, it has been analyzed and rejected substantially similar to claim 18. 



1 . Claims 23 - 26 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Cui in view of Croney, as applied to claims 15-22 above, and further in view 
of MacPhail (US 6,593,943 B1). 

Re claim 23, Cui teaches a computer readable storage medium in which data is 
recorded, the data comprising: first display capability information of a first display device 
in a user terminal (Para 0037; "If a color segment brightness level exceeds or falls 
below the respective segment threshold/display capability by a certain amount, this 
information/data is relayed to a software program, which determines whether the display 
image brightness or backlight brightness should be adjusted." The display capability 
information is the information used to maintain a pre-determined display image quality. 
The user terminal is where the display device as shown in Fig. 1 . The adaptation 
means is the system as shown in Fig. 1 . The data must be stored in a memory which is 
processor/computer readable storage medium.), wherein visual data is adapted by a 
video adaptation apparatus (The adaptation apparatus is a part of the system which 
uses a software to adjust visual data as shown in Fig. 1 .) that is particular from the user 
terminal (As can be seen in Fig. 1, the system and the display device in a user terminal 
are particular to each other.) according to the display capability information and a usage 
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environment of the particular user terminal (Para 0038; "an ambient light sensor is used 
to determined the brightness of ambient light surrounding a display monitor, in which the 
display image will be display. The image may then be adjusted to account for ambient 
light brightness.") the display capability information is hierarchically structured to include 
backlight luminance information as a sub-element of the display capability information 
(Para 0037; "when a color brightness level exceeds or falls below a threshold by an 
amount, an interrupt is generated causing a software program to either program the 
graphics gamma unit to adjust the display image brightness or enable the PWM to 
adjust the display backlight brightness in order to maintain a pre-determined display 
image quality." In order to maintain the pre-determined display image quality, which is 
the display capability, the software program must contain both the display image 
brightness and the backlight brightness information as sub-elements to dynamically 
adjust the image brightness.), and the backlight luminance information is described as a 
numerical value ranging from the lowest possible value to the highest possible value 
that is adjusted according to the usage environment of the particular user terminal (Para 
0037; "if a target display image quality can be achieved by adjusting the backlight 
brightness while maintaining a target display device power target, then the PWM will be 
programmed accordingly. Otherwise, the target display image quality will be achieved 
by adjusting the display image brightness." The adjustment of the backlight brightness is 
conducted by a program wherein the backlight brightness is described digitally in 
numerical values. The range of the backlight brightness information is determined by 
the target display image quality described above. In other words, if the highest possible 
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value of the backlight is not sufficient, the software program will relay the information to 
adjust the image data.). 

But does not expressly teach adapting the visual data in response to received 
second display capability information of a second display device in a second user 
terminal and providing a single source, multi-use environment, where one content is 
adapted to and used in different usage environments. 

However, Croney teaches a method for rendering images for display on client 
devices wherein an image or images having the appropriate size and format compatible 
with each client device based on the capabilities and environment associated with the 
particular client device is generated from a single source image (Croney: Para 0009). 

Therefore, taking the combined teachings of Cui and Croney, as a whole, it 
would have been obvious to a person having ordinary skill in the art to incorporate the 
idea of renderings images on a plurality of client devices wherein images having the 
appropriate size and format compatible with each client device based on the capabilities 
associated with the particular client device is generated from a single source image as 
taught by Croney into t the computer readable storage medium comprising display 
capability information of display device in a user terminal of Cui to obtain a computer 
readable storage medium comprising a visual data adaptation apparatus wherein the 
apparatus to adapt visual data in response to received display capability information of 
a plurality of display devices including a first and a second display in separate user 
terminals to adept a single-source content be used in different usage environments to 
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allow a single source content to be properly displayed on a multiple client devices 
automatically. 

But does not expressly disclose said metadata. 

However, MacPhail teaches a method for displaying computer-based information 
including detecting an instruction to display an information unit based on the data and or 
metadata stored in storage medium (MacPhail: Col. 10, line 63 - Col 1 1 line 34). 

Therefore, taking the combined teachings of Cui, Croney and MacPhail, as a 
whole, it would have been obvious to a person having ordinary skill in the art to 
incorporate the idea of displaying information based on metadata as taught by MacPhail 
into the computer readable storage medium as taught by Cui and Croney to obtain a 
computer readable storage medium in which metadata is recorded wherein the 
metadata comprises display capability information of a display device to adapt visual 
data according to the display capability information in an efficient was since the 
metadata can travel along with other data such as video data. 

The limitations of claim 24 are substantially similar to the limitations of claim 16. 
Therefore, it has been analyzed and rejected substantially similar to claim 16. 

The limitations of claim 25 are substantially similar to the limitations of claim 1 7. 
Therefore, it has been analyzed and rejected substantially similar to claim 17. 
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The limitations of claim 26 are substantially similar to the limitations of claim 18. 
Therefore, it has been analyzed and rejected substantially similar to claim 18. 

Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to YONG SIM whose telephone number is (571)270-1189. 
The examiner can normally be reached on Monday - Friday (Alternate Fridays off) 7:30- 
5:00. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Amr Awad can be reached on (571 ) 272-7764. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 



/YONG SIM/ 
Examiner, Art Unit 2629 
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